Minimum clinical utility standards for wearable seizure detectors: A simulation study.

OBJECTIVE: Epilepsy management employs self-reported seizure diaries, despite evidence of seizure underreporting. Wearable and implantable seizure detection devices are now becoming more widely available. There are no clear guidelines about what levels of accuracy are sufficient. This study aimed to simulate clinical use cases and identify the necessary level of accuracy for each. METHODS: Using a realistic seizure simulator (CHOCOLATES), a ground truth was produced, which was then sampled to generate signals from simulated seizure detectors of various capabilities. Five use cases were evaluated: (1) randomized clinical trials (RCTs), (2) medication adjustment in clinic, (3) injury prevention, (4) sudden unexpected death in epilepsy (SUDEP) prevention, and (5) treatment of seizure clusters. We considered sensitivity (0%-100%), false alarm rate (FAR; 0-2/day), and device type (external wearable vs. implant) in each scenario. RESULTS: The RCT case was efficient for a wide range of wearable parameters, though implantable devices were preferred. Lower accuracy wearables resulted in subtle changes in the distribution of patients enrolled in RCTs, and therefore higher sensitivity and lower FAR values were preferred. In the clinic case, a wide range of sensitivity, FAR, and device type yielded similar results. For injury prevention, SUDEP prevention, and seizure cluster treatment, each scenario required high sensitivity and yet was minimally influenced by FAR. SIGNIFICANCE: The choice of use case is paramount in determining acceptable accuracy levels for a wearable seizure detection device. We offer simulation results for determining and verifying utility for specific use case and specific wearable parameters.

Analyzing physiological signals recorded with a wearable sensor across the menstrual cycle using circular statistics.

This study aims to identify the most significant features in physiological signals representing a biphasic pattern in the menstrual cycle using circular statistics which is an appropriate analytic method for the interpretation of data with a periodic nature. The results can be used empirically to determine menstrual phases. A non-uniform pattern was observed in ovulating subjects, with a significant periodicity (p<0.05) in mean temperature, heart rate (HR), Inter-beat Interval (IBI), mean tonic component of Electrodermal Activity (EDA), and signal magnitude area (SMA) of the EDA phasic component in the frequency domain. In contrast, non-ovulating cycles displayed a more uniform distribution (p>0.05). There was a significant difference between ovulating and non-ovulating cycles (p<0.05) in temperature, IBI, and EDA but not in mean HR. Selected features were used in training an Autoregressive Integrated Moving Average (ARIMA) model, using data from at least one cycle of a subject, to predict the behavior of the signal in the last cycle. By iteratively retraining the algorithm on a per-day basis, the mean temperature, HR, IBI and EDA tonic values of the next day were predicted with root mean square error (RMSE) of 0.13 ± 0.07 (C°), 1.31 ± 0.34 (bpm), 0.016 ± 0.005 (s) and 0.17 ± 0.17 (µS), respectively.

Seizure occurrence is linked to multiday cycles in diverse physiological signals.

OBJECTIVE: The factors that influence seizure timing are poorly understood, and seizure unpredictability remains a major cause of disability. Work in chronobiology has shown that cyclical physiological phenomena are ubiquitous, with daily and multiday cycles evident in immune, endocrine, metabolic, neurological, and cardiovascular function. Additionally, work with chronic brain recordings has identified that seizure risk is linked to daily and multiday cycles in brain activity. Here, we provide the first characterization of the relationships between the cyclical modulation of a diverse set of physiological signals, brain activity, and seizure timing. METHODS: In this cohort study, 14 subjects underwent chronic ambulatory monitoring with a multimodal wrist-worn sensor (recording heart rate, accelerometry, electrodermal activity, and temperature) and an implanted responsive neurostimulation system (recording interictal epileptiform abnormalities and electrographic seizures). Wavelet and filter-Hilbert spectral analyses characterized circadian and multiday cycles in brain and wearable recordings. Circular statistics assessed electrographic seizure timing and cycles in physiology. RESULTS: Ten subjects met inclusion criteria. The mean recording duration was 232 days. Seven subjects had reliable electroencephalographic seizure detections (mean = 76 seizures). Multiday cycles were present in all wearable device signals across all subjects. Seizure timing was phase locked to multiday cycles in five (temperature), four (heart rate, phasic electrodermal activity), and three (accelerometry, heart rate variability, tonic electrodermal activity) subjects. Notably, after regression of behavioral covariates from heart rate, six of seven subjects had seizure phase locking to the residual heart rate signal. SIGNIFICANCE: Seizure timing is associated with daily and multiday cycles in multiple physiological processes. Chronic multimodal wearable device recordings can situate rare paroxysmal events, like seizures, within a broader chronobiology context of the individual. Wearable devices may advance the understanding of factors that influence seizure risk and enable personalized time-varying approaches to epilepsy care.

Data quality evaluation in wearable monitoring.

Wearable recordings of neurophysiological signals captured from the wrist offer enormous potential for seizure monitoring. Yet, data quality remains one of the most challenging factors that impact data reliability. We suggest a combined data quality assessment tool for the evaluation of multimodal wearable data. We analyzed data from patients with epilepsy from four epilepsy centers. Patients wore wristbands recording accelerometry, electrodermal activity, blood volume pulse, and skin temperature. We calculated data completeness and assessed the time the device was worn (on-body), and modality-specific signal quality scores. We included 37,166 h from 632 patients in the inpatient and 90,776 h from 39 patients in the outpatient setting. All modalities were affected by artifacts. Data loss was higher when using data streaming (up to 49% among inpatient cohorts, averaged across respective recordings) as compared to onboard device recording and storage (up to 9%). On-body scores, estimating the percentage of time a device was worn on the body, were consistently high across cohorts (more than 80%). Signal quality of some modalities, based on established indices, was higher at night than during the day. A uniformly reported data quality and multimodal signal quality index is feasible, makes study results more comparable, and contributes to the development of devices and evaluation routines necessary for seizure monitoring.

Seizure forecasting using minimally invasive, ultra-long-term subcutaneous electroencephalography: Individualized intrapatient models.

OBJECTIVE: One of the most disabling aspects of living with chronic epilepsy is the unpredictability of seizures. Cumulative research in the past decades has advanced our understanding of the dynamics of seizure risk. Technological advances have recently made it possible to record pertinent biological signals, including electroencephalogram (EEG), continuously. We aimed to assess whether patient-specific seizure forecasting is possible using remote, minimally invasive ultra-long-term subcutaneous EEG. METHODS: We analyzed a two-center cohort of ultra-long-term subcutaneous EEG recordings, including six patients with drug-resistant focal epilepsy monitored for 46-230 days with median 18 h/day of recorded data, totaling >11 000 h of EEG. Total electrographic seizures identified by visual review ranged from 12 to 36 per patient. Three candidate subject-specific long short-term memory network deep learning classifiers were trained offline and pseudoprospectively on preictal (1 h before) and interictal (>1 day from seizures) EEG segments. Performance was assessed relative to a random predictor. Periodicity of the final forecasts was also investigated with autocorrelation. RESULTS: Depending on each architecture, significant forecasting performance was achieved in three to five of six patients, with overall mean area under the receiver operating characteristic curve of .65-.74. Significant forecasts showed sensitivity ranging from 64% to 80% and time in warning from 10.9% to 44.4%. Overall, the output of the forecasts closely followed patient-specific circadian patterns of seizure occurrence. SIGNIFICANCE: This study demonstrates proof-of-principle for the possibility of subject-specific seizure forecasting using a minimally invasive subcutaneous EEG device capable of ultra-long-term at-home recordings. These results are encouraging for the development of a prospective seizure forecasting trial with minimally invasive EEG.

Seizure forecasting using minimally invasive, ultra-long-term subcutaneous EEG: Generalizable cross-patient models.

This study describes a generalized cross-patient seizure-forecasting approach using recurrent neural networks with ultra-long-term subcutaneous EEG (sqEEG) recordings. Data from six patients diagnosed with refractory epilepsy and monitored with an sqEEG device were used to develop a generalized algorithm for seizure forecasting using long short-term memory (LSTM) deep-learning classifiers. Electrographic seizures were identified by a board-certified epileptologist. One-minute data segments were labeled as preictal or interictal based on their relationship to confirmed seizures. Data were separated into training and testing data sets, and to compensate for the unbalanced data ratio in training, noise-added copies of preictal data segments were generated to expand the training data set. The mean and standard deviation (SD) of the training data were used to normalize all data, preserving the pseudo-prospective nature of the analysis. Different architecture classifiers were trained and tested using a leave-one-patient-out cross-validation method, and the area under the receiver-operating characteristic (ROC) curve (AUC) was used to evaluate the performance classifiers. The importance of each input signal was evaluated using a leave-one-signal-out method with repeated training and testing for each classifier. Cross-patient classifiers achieved performance significantly better than chance in four of the six patients and an overall mean AUC of 0.602 ± 0.126 (mean ± SD). A time in warning of 37.386% ± 5.006% (mean ± std) and sensitivity of 0.691 ± 0.068 (mean ± std) were observed for patients with better than chance results. Analysis of input channels showed a significant contribution (p < .05) by the Fourier transform of signals channels to overall classifier performance. The relative contribution of input signals varied among patients and architectures, suggesting that the inclusion of all signals contributes to robustness in a cross-patient classifier. These early results show that it is possible to forecast seizures training with data from different patients using two-channel ultra-long-term sqEEG.

Ambulatory seizure forecasting with a wrist-worn device using long-short term memory deep learning.

The ability to forecast seizures minutes to hours in advance of an event has been verified using invasive EEG devices, but has not been previously demonstrated using noninvasive wearable devices over long durations in an ambulatory setting. In this study we developed a seizure forecasting system with a long short-term memory (LSTM) recurrent neural network (RNN) algorithm, using a noninvasive wrist-worn research-grade physiological sensor device, and tested the system in patients with epilepsy in the field, with concurrent invasive EEG confirmation of seizures via an implanted recording device. The system achieved forecasting performance significantly better than a random predictor for 5 of 6 patients studied, with mean AUC-ROC of 0.80 (range 0.72-0.92). These results provide the first clear evidence that direct seizure forecasts are possible using wearable devices in the ambulatory setting for many patients with epilepsy.

Epilepsy Personal Assistant Device-A Mobile Platform for Brain State, Dense Behavioral and Physiology Tracking and Controlling Adaptive Stimulation.

Epilepsy is one of the most common neurological disorders, and it affects almost 1% of the population worldwide. Many people living with epilepsy continue to have seizures despite anti-epileptic medication therapy, surgical treatments, and neuromodulation therapy. The unpredictability of seizures is one of the most disabling aspects of epilepsy. Furthermore, epilepsy is associated with sleep, cognitive, and psychiatric comorbidities, which significantly impact the quality of life. Seizure predictions could potentially be used to adjust neuromodulation therapy to prevent the onset of a seizure and empower patients to avoid sensitive activities during high-risk periods. Long-term objective data is needed to provide a clearer view of brain electrical activity and an objective measure of the efficacy of therapeutic measures for optimal epilepsy care. While neuromodulation devices offer the potential for acquiring long-term data, available devices provide very little information regarding brain activity and therapy effectiveness. Also, seizure diaries kept by patients or caregivers are subjective and have been shown to be unreliable, in particular for patients with memory-impairing seizures. This paper describes the design, architecture, and development of the Mayo Epilepsy Personal Assistant Device (EPAD). The EPAD has bi-directional connectivity to the implanted investigational Medtronic Summit RC+STM device to implement intracranial EEG and physiological monitoring, processing, and control of the overall system and wearable devices streaming physiological time-series signals. In order to mitigate risk and comply with regulatory requirements, we developed a Quality Management System (QMS) to define the development process of the EPAD system, including Risk Analysis, Verification, Validation, and protocol mitigations. Extensive verification and validation testing were performed on thirteen canines and benchtop systems. The system is now under a first-in-human trial as part of the US FDA Investigational Device Exemption given in 2018 to study modulated responsive and predictive stimulation using the Mayo EPAD system and investigational Medtronic Summit RC+STM in ten patients with non-resectable dominant or bilateral mesial temporal lobe epilepsy. The EPAD system coupled with an implanted device capable of EEG telemetry represents a next-generation solution to optimizing neuromodulation therapy.

Seizure Diaries and Forecasting With Wearables: Epilepsy Monitoring Outside the Clinic.

It is a major challenge in clinical epilepsy to diagnose and treat a disease characterized by infrequent seizures based on patient or caregiver reports and limited duration clinical testing. The poor reliability of self-reported seizure diaries for many people with epilepsy is well-established, but these records remain necessary in clinical care and therapeutic studies. A number of wearable devices have emerged, which may be capable of detecting seizures, recording seizure data, and alerting caregivers. Developments in non-invasive wearable sensors to measure accelerometry, photoplethysmography (PPG), electrodermal activity (EDA), electromyography (EMG), and other signals outside of the traditional clinical environment may be able to identify seizure-related changes. Non-invasive scalp electroencephalography (EEG) and minimally invasive subscalp EEG may allow direct measurement of seizure activity. However, significant network and computational infrastructure is needed for continuous, secure transmission of data. The large volume of data acquired by these devices necessitates computer-assisted review and detection to reduce the burden on human reviewers. Furthermore, user acceptability of such devices must be a paramount consideration to ensure adherence with long-term device use. Such devices can identify tonic-clonic seizures, but identification of other seizure semiologies with non-EEG wearables is an ongoing challenge. Identification of electrographic seizures with subscalp EEG systems has recently been demonstrated over long (>6 month) durations, and this shows promise for accurate, objective seizure records. While the ability to detect and forecast seizures from ambulatory intracranial EEG is established, invasive devices may not be acceptable for many individuals with epilepsy. Recent studies show promising results for probabilistic forecasts of seizure risk from long-term wearable devices and electronic diaries of self-reported seizures. There may also be predictive value in individuals' symptoms, mood, and cognitive performance. However, seizure forecasting requires perpetual use of a device for monitoring, increasing the importance of the system's acceptability to users. Furthermore, long-term studies with concurrent EEG confirmation are lacking currently. This review describes the current evidence and challenges in the use of minimally and non-invasive devices for long-term epilepsy monitoring, the essential components in remote monitoring systems, and explores the feasibility to detect and forecast impending seizures via long-term use of these systems.

Non-invasive wearable seizure detection using long-short-term memory networks with transfer learning.

Objective. The detection of seizures using wearable devices would improve epilepsy management, but reliable detection of seizures in an ambulatory environment remains challenging, and current studies lack concurrent validation of seizures using electroencephalography (EEG) data.Approach. An adaptively trained long-short-term memory deep neural network was developed and trained using a modest number of seizure data sets from wrist-worn devices. Transfer learning was used to adapt a classifier that was initially trained on intracranial electroencephalography (iEEG) signals to facilitate classification of non-EEG physiological datasets comprising accelerometry, blood volume pulse, skin electrodermal activity, heart rate, and temperature signals. The algorithm's performance was assessed with and without pre-training on iEEG signals and transfer learning. To assess the performance of the seizure detection classifier using long-term ambulatory data, wearable devices were used for multiple months with an implanted neurostimulator capable of recording iEEG signals, which provided independent electrographic seizure detections that were reviewed by a board-certified epileptologist.Main results. For 19 motor seizures from 10 in-hospital patients, the algorithm yielded a mean area under curve (AUC), a sensitivity, and an false alarm rate per day (FAR/day) of 0.98, 0.93, and 2.3, respectively. Additionally, for eight seizures with probable motor semiology from two ambulatory patients, the classifier achieved a mean AUC of 0.97 and an FAR of 2.45 events/day at a sensitivity of 0.9. For all seizure types in the ambulatory setting, the classifier had a mean AUC of 0.82 with a sensitivity of 0.47 and an FAR of 7.2 events/day.Significance. The performance of the algorithm was evaluated using motor and non-motor seizures during in-hospital and ambulatory use. The classifier was able to detect multiple types of motor and non-motor seizures, but performed significantly better on motor seizures.

Semi-supervised Training Data Selection Improves Seizure Forecasting in Canines with Epilepsy.

OBJECTIVE: Conventional selection of pre-ictal EEG epochs for seizure prediction algorithm training data typically assumes a continuous pre-ictal brain state preceding a seizure. This is carried out by defining a fixed duration, pre-ictal time period before seizures from which pre-ictal training data epochs are uniformly sampled. However, stochastic physiological and pathological fluctuations in EEG data characteristics and underlying brain states suggest that pre-ictal state dynamics may be more complex, and selection of pre-ictal training data segments to reflect this could improve algorithm performance. METHODS: We propose a semi-supervised technique to select pre-ictal training data most distinguishable from interictal EEG according to pre-specified data characteristics. The proposed method uses hierarchical clustering to identify optimal pre-ictal data epochs. RESULTS: In this paper we compare the performance of a seizure forecasting algorithm with and without hierarchical clustering of pre-ictal periods in chronic iEEG recordings from six canines with naturally occurring epilepsy. Hierarchical clustering of training data improved results for Time In Warning (TIW) (0.18 vs. 0.23) and False Positive Rate (FPR) (0.5 vs. 0.59) when evaluated across all subjects (p<0.001, n=6). Results were mixed when evaluating TIW, FPR, and Sensitivity for individual dogs. CONCLUSION: Hierarchical clustering is a helpful method for training data selection overall, but should be evaluated on a subject-wise basis. SIGNIFICANCE: The clustering method can be used to optimize results of forecasting towards sensitivity or TIW or FPR, and therefore can be useful for epilepsy management.

Signal quality and patient experience with wearable devices for epilepsy management.

Noninvasive wearable devices have great potential to aid the management of epilepsy, but these devices must have robust signal quality, and patients must be willing to wear them for long periods of time. Automated machine learning classification of wearable biosensor signals requires quantitative measures of signal quality to automatically reject poor-quality or corrupt data segments. In this study, commercially available wearable sensors were placed on patients with epilepsy undergoing in-hospital or in-home electroencephalographic (EEG) monitoring, and healthy volunteers. Empatica E4 and Biovotion Everion were used to record accelerometry (ACC), photoplethysmography (PPG), and electrodermal activity (EDA). Byteflies Sensor Dots were used to record ACC and PPG, the Activinsights GENEActiv watch to record ACC, and Epitel Epilog to record EEG data. PPG and EDA signals were recorded for multiple days, then epochs of high-quality, marginal-quality, or poor-quality data were visually identified by reviewers, and reviewer annotations were compared to automated signal quality measures. For ACC, the ratio of spectral power from 0.8 to 5 Hz to broadband power was used to separate good-quality signals from noise. For EDA, the rate of amplitude change and prevalence of sharp peaks significantly differentiated between good-quality data and noise. Spectral entropy was used to assess PPG and showed significant differences between good-, marginal-, and poor-quality signals. EEG data were evaluated using methods to identify a spectral noise cutoff frequency. Patients were asked to rate the usability and comfort of each device in several categories. Patients showed a significant preference for the wrist-worn devices, and the Empatica E4 device was preferred most often. Current wearable devices can provide high-quality data and are acceptable for routine use, but continued development is needed to improve data quality, consistency, and management, as well as acceptability to patients.

Circadian and multiday seizure periodicities, and seizure clusters in canine epilepsy.

Advances in ambulatory intracranial EEG devices have enabled objective analyses of circadian and multiday seizure periodicities, and seizure clusters in humans. This study characterizes circadian and multiday seizure periodicities, and seizure clusters in dogs with naturally occurring focal epilepsy, and considers the implications of an animal model for the study of seizure risk patterns, seizure forecasting and personalized treatment protocols. In this retrospective cohort study, 16 dogs were continuously monitored with ambulatory intracranial EEG devices designed for humans. Detailed medication records were kept for all dogs. Seizure periodicity was evaluated with circular statistics methods. Circular non-uniformity was assessed for circadian, 7-day and approximately monthly periods. The Rayleigh test was used to assess statistical significance, with correction for multiple comparisons. Seizure clusters were evaluated with Fano factor (index of dispersion) measurements, and compared to a Poisson distribution. Relationships between interseizure interval (ISI) and seizure duration were evaluated. Six dogs met the inclusion criteria of having at least 30 seizures and were monitored for an average of 65 weeks. Three dogs had seizures with circadian seizure periodicity, one dog had a 7-day periodicity, and two dogs had approximately monthly periodicity. Four dogs had seizure clusters and significantly elevated Fano factor values. There were subject-specific differences in the dynamics of ISI and seizure durations, both within and between lead and clustered seizure categories. Our findings show that seizure timing in dogs with naturally occurring epilepsy is not random, and that circadian and multiday seizure periodicities, and seizure clusters are common. Circadian, 7-day, and monthly seizure periodicities occur independent of antiseizure medication dosing, and these patterns likely reflect endogenous rhythms of seizure risk.

Deep-learning for seizure forecasting in canines with epilepsy.

OBJECTIVE: This paper introduces a fully automated, subject-specific deep-learning convolutional neural network (CNN) system for forecasting seizures using ambulatory intracranial EEG (iEEG). The system was tested on a hand-held device (Mayo Epilepsy Assist Device) in a pseudo-prospective mode using iEEG from four canines with naturally occurring epilepsy. APPROACH: The system was trained and tested on 75 seizures collected over 1608 d utilizing a genetic algorithm to optimize forecasting hyper-parameters (prediction horizon (PH), median filter window length, and probability threshold) for each subject-specific seizure forecasting model. The trained CNN models were deployed on a hand-held tablet computer and tested on testing iEEG datasets from four canines. The results from the iEEG testing datasets were compared with Monte Carlo simulations using a Poisson random predictor with equal time in warning to evaluate seizure forecasting performance. MAIN RESULTS: The results show the CNN models forecasted seizures at rates significantly above chance in all four dogs (p  < 0.01, with mean 0.79 sensitivity and 18% time in warning). The deep learning method presented here surpassed the performance of previously reported methods using computationally expensive features with standard machine learning methods like logistic regression and support vector machine classifiers. SIGNIFICANCE: Our findings principally support the feasibility of deploying trained CNN models on a hand-held computational device (Mayo Epilepsy Assist Device) that analyzes streaming iEEG data for real-time seizure forecasting.

Integrating Brain Implants With Local and Distributed Computing Devices: A Next Generation Epilepsy Management System.

Brain stimulation has emerged as an effective treatment for a wide range of neurological and psychiatric diseases. Parkinson's disease, epilepsy, and essential tremor have FDA indications for electrical brain stimulation using intracranially implanted electrodes. Interfacing implantable brain devices with local and cloud computing resources have the potential to improve electrical stimulation efficacy, disease tracking, and management. Epilepsy, in particular, is a neurological disease that might benefit from the integration of brain implants with off-the-body computing for tracking disease and therapy. Recent clinical trials have demonstrated seizure forecasting, seizure detection, and therapeutic electrical stimulation in patients with drug-resistant focal epilepsy. In this paper, we describe a next-generation epilepsy management system that integrates local handheld and cloud-computing resources wirelessly coupled to an implanted device with embedded payloads (sensors, intracranial EEG telemetry, electrical stimulation, classifiers, and control policy implementation). The handheld device and cloud computing resources can provide a seamless interface between patients and physicians, and realtime intracranial EEG can be used to classify brain state (wake/sleep, preseizure, and seizure), implement control policies for electrical stimulation, and track patient health. This system creates a flexible platform in which low demand analytics requiring fast response times are embedded in the implanted device and more complex algorithms are implemented in offthebody local and distributed cloud computing environments. The system enables tracking and management of epileptic neural networks operating over time scales ranging from milliseconds to months.